Lookups using Controlled Pre xExpansionV

Internet (IP) address lookup is a major bottleneck in high performance routers. IP address lookup is challenging because it requires a longest matching preex lookup. It is compounded by increasing routing table sizes, increased traac, higher speed links, and the migration to 128 bit IPv6 addresses. We describe how IP lookups and updates can be made faster using a set of transformation techniques. Our main technique, controlled preex expansion, transforms a set of preexes into an equivalent set with fewer preex lengths. In addition, we use optimization techniques based on dynamic programming, and local transformations of data structures to improve cache behavior. When applied to trie search, our techniques provide a range of algorithms (Expanded Tries) whose performance can be tuned. For example, using a processor with 1 MB of L2 cache, search of the MaeEast database containing38000 preexes can be done in 3 L2 cache accesses. On a 300 MHz Pentium II which takes 4 cycles for accessing the rst word of the L2 cacheline, this algorithm has a worst-case search time of 180 nsec, a worst case insert/delete time of 2.5 msec, and an average insert/delete time of 4 usec. Expanded tries provide faster search and faster insert/delete times than earlier lookup algorithms. When applied to Binary Search on Levels, our techniques improve worst-case search times by nearly a factor of two (using twice as much storage) for the MaeEast database. Our approach to algorithm design is based on measurements using the VTune tool on a Pentium to obtain dynamic clock cycle counts. Our techniques also apply to similar address lookup problems in other network protocols.